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The paradigm of stochastic resonance (SR) — the idea that 
signal detection and transmission may benefit from noise — 
has met with great interest in both physics and the neuro- 
sciences. We investigate here the consequences of reducing 
the dynamics of a periodically driven neuron to a renewal pro- 
cess (stimulation with reset or endogenous stimulation) . This 
greatly simplifies the mathematical analysis, but we show that 
stochastic resonance as reported earlier occurs in this model 
only as a consequence of the reduced dynamics. 
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I. INTRODUCTION 

The improvement of signal transmission and detection 
through noise has been studied keenly over the past two 
decades under the paradigm of stochastic resonance; for 
recent reviews see Refs. This holds true for the 

neurosciences in particular, which have for a long time 
been puzzled by the seemingly irregular activity of the 
nervous system. A long series of experiments has now 
firmly established that sensory neurons of various modal- 
ities benefit from ambient noise [|[j9|. 

Theoretical efforts to explain stochastic resonance in 
neuronal systems had to abstract rigorously from the bi- 
ological complexity of real neurons to facilitate mathe- 
matical treatment [|10H14|. The leaky integrate-and-fire 



model neuron (LIF) llSl is likely the most widely studied 
of these abstract neuron models, especially in investiga- 
tions of the neuronal code . The main advantages 
of this model are its simplicity and lack of memory: Each 
time the neuron has been excited sufficiently to fire a 
spike (output pulse), it is reset to a predefined state, eras- 
ing all memory of past input. One may thus analyze the 
intervals between spikes separately, and build the com- 
plete spike train fired by the neuron by concatenation of 
intervals. 

Time-dependent stimulation complicates this proce- 
dure, though, as a different stimulus is now presented 
during each interspike interval. This precludes a straight- 
forward analysis of global properties of the spike train, 
such as its power spectral density. Since stochastic reso- 
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nance is typically defined in terms of the signal-to-noise 
ratio in response to periodic stimulation, either of the fol- 
lowing is required: (i) further simplification of the model, 
or (ii) the development of better techniques. 

The latter is certainly preferable and has been achieved 
in the meantime |22-G4]. Stochastic resonance with re- 
spect to both noise amplitude and signal frequency has 
been found, and may be relevant to signal processing 
in neuronal networks [ ^J26| . Results obtained for the 
leaky integrate-and-fire neuron are in qualitative agree- 
ment with those obtained from more realistic, non-linear 
models [ p7|p^ , indicating that the abstraction to the LIF 
model was acceptable. 

Albeit stochastic resonance in the leaky integrate-and- 
fire model may thus be considered a solved problem, 
we would like to return here to some earlier studies 
p9|- ^p3| , which, at least in parts, followed the sim- 
plifying approach (i). These studies assumed that the 
same stimulus was presented during each interspike in- 
terval, i.e., that the originally periodic stimulus was re- 
set to a fixed phase (f>o after each spike. All intervals are 
thus equivalent, and global properties of the spike train 
may be computed from the interspike-interval distribu- 
tion for a single interval using the methods of renewal 
theory | |3^ ]. Lansky coined the terms endogenous and 
exogenous stimulation for stimulation with and without 
reset, respectively Q. 

This stimulus-reset assumption is patently unbiologi- 
cal for virtually all neurons, since it would require the 
neuron to fully control the input it receives. The reset 
assumption was therefore justified as an approximation 
to the full, exogenous dynamics of a periodically driven 
noisy neuron along the following lines : If the neuron 
is driven by a periodic subthreshold stimulus (a stimu- 
lus too weak to evoke spikes in the absence of noise), 
then the neuron will fire all spikes at approximately the 
same stimulus phase 4>* after transients have died out. 
This phase corresponds roughly to the phase at which the 
membrane potential is maximal in the absence of noise. 
Such firing patterns are found in sensory neurons, e.g., in 
the auditory nerve [^5| or cold-receptor neurons p6| , p7t . 
Thus, roughly the same stimulus, starting from phase 
0(r — 0) ^ (j>*, is presented during each interval. Reset- 
ting the stimulus phase to a fixed phase 0(r = 0) = (/)o 
will therefore introduce only minor errors. 

This reasoning suffers from an essential shortcoming, 
namely the choice of a fixed reset phase independent 
of both stimulus and noise. This reset phase is a free 
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parameter of the model, which has no counterpart in bi- 
ological neurons. We show here that stochastic resonance 
in terms of the signal-to-noise ratio as studied previously 
in the LIF model with stimulus reset |]30| , ^ , p3| occurs 
because the model neuron adapts best to the free param- 
eter "reset phase" for a particular noise amplitude. The 
signal-to-noise ratio as defined in those studies diverges 
monotonically for vanishing noise if the reset phase is 
adapted to stimulus and noise in a plausible way. 

The leaky integrate-and-fire model and the methods 
applied in analysis are briefly reviewed in Sec. O; see 
Ref. ||2^ for details. Results are presented in Sec. Q and 
summarized in Sec. IV 



Because of the stimulus reset and the whiteness of the 
noise, all interspike interval lengths are statistically in- 
dependent, identically distributed random variables with 
density p(t). The latter can be computed numerically 
or approximated in closed form p6|j4l| ,4^. The sequence 
of intervals thus forms a renewal process, which is fully 
characterized by the ISI density p{t) |43|. Periodic sub- 
threshold stimulation evokes multimodal ISI densities as 
shown in Fig. || for noise not too strong. The location 
of the first peak depends on the reset phase (j)o, while 
subsequent peaks follow at intervals of the nominal stim- 
ulus period T = 27r/f2. Comparable ISI distributions are 
found in sensory neurons [p5|,p6 44 1. 



II. MODEL AND METHODS 



B. Signal-to-noise ratio 



A. Leaky integrate-and-fire neuron 

The leaky integrate-and-fire neuron model sketches the 
neuron as a capacitor with leak current, which is charged 
by an input current I(t) until the potential v{t) across 
the capacitor (membrane potential) reaches a threshold 
Q. At that instant, an output spike is recorded and the 
potential reset to < 6. The assumption that the stim- 
ulus is reset after each spike as well implies that the mem- 
brane potential evolves according to 



v{t) = -v{t) + fi + q cos(r2r + 4>q) + cr^(r). 



(1) 



in between any two spikes [T^ ]; r is intra-interval time, 
i.e., T runs from zero in every interval, /i is the DC 
component of the stimulus, q its AC amplitude, Q the 
nominal frequency, and (j)Q the fixed but arbitrary reset 
phase. All quantities are measured in their natural units, 
i.e., the membrane time constant Tm and threshold 8. 

= is assumed throughout. The noise term in Eq . dj] ) 
subsumes both biochemical and network noise ||38| , |39| , 
and is taken to be Gaussian white noise [{^{t)^{t')) = 
6{t — t')]. A different realization of the noise is used for 
each interval. Sub-threshold stimuli are characterized by 
supj^o^ v{t) =11 + q/^/l+T)? < 1 for (7 = 0. We restrict 
ourselves here to these stimuli, because they appear to 
be more relevant for the encoding of periodic signals in 
sensory systems than superthreshold stimuli |]l6|,Q . 

The sequence ri , r2 , . . . , , . . . of intervals corresponds 
to an output spike train f(t) = S{t — tk) with spike 
times tk = Sj<fe Tj - This spike train is evoked by an ef- 
fective stimulus consisting of piecewise sinusoids of length 
Tfe, as shown in Fig. |l|. In contrast, we call the pure si- 
nusoid cos{ilt + (po) the nominal stimulus. Figure ^ indi- 
cates that the effective stimulus approximates the nom- 
inal stimulus for a reset phase of 4>q ~ 0, while it is an 
irregular sequence of piecewise sinusoids for other choices 
of the reset phase. We therefore focus here on (/iq = in 
accordance with earlier work P(l,p]l,E3|. 



The performance of a signal processor is commonly 
measured in terms of the signal-to-noise ratio in studies 
on stochastic resonance. Since the spike train elicited 
from the neuron is a renewal process by virtue of the 
stimulus reset, its power spectral density (PSD) is given 
by [|2|J30| 



S{uj) = ^(l + 2n-^^^],oj>0, (2) 



7r(r) 



■l-p(c^) 



where 



Pico) = / p(r)e^--dr 
Jo 



(3) 



is the Fourier transform of the ISI density and (r) the 
mean interspike interval length; note that p(t) = for 
T < by definition. 

The input to the neuron is not purely sinusoidal due 
to the stimulus reset, and the maximum of the PSD will 
thus be shifted away from the stimulus frequency fi, see 
Fig. ||(a). We thus define the signal as the maximum of 
the PSD in a window around fl MM 



S = S{n) = max{S'(w)|0.917 < u < l.m} 



(4) 



and refer to the location i7 of the maximum as peak fre- 
quency. The signal S is undefined if 5(w) has no absolute 
maximum within the window as, e.g., in Fig. ^(b). The 
white power spectrum of a Poissonian spike train of equal 
intensity, Sp = (7r(T))^^, is used as reference noise level 
|{45|, whence the signal-to- noise ratio is 



-RsN = S/Sp = tt{t)S. 



(5) 



Note that power spectral density and signal-to-noise 
ratio as defined above are calculated for infinitely long 
spike trains. Any strictly periodic component of the spike 
train will thus give rise to singularities in the PSD. In the 
reset model, coherence is broken by the stimulus reset, 
resulting in a continuous spectrum Q,|2^. Due to the 
different definitions, signal-to-noise ratios obtained from 
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the LIF model with and without stimulus reset cannot 
be compared quantitatively [^ . 

The spectrum defined by Eq. (H) may have very nar- 
row peaks for low noise, whence numerical evaluation of 
Eqs. (||)-(||) may require very high frequency resolution. 



C. Preferred firing phase 

If the stimulus is not reset after each spike, the proba- 
bility ^^''+^'> [ijj) for the A: -I- 1-st spike to occur at stimulus 
phase V' can be expressed in terms of the corresponding 
distribution for the fc-th spike as 



T{i,\c^)x^''\cj,)dcj, 



(6) 



where T{ip\(j)) is a stochastic kernel For A; ^ oo, 

the firing phase distribution will approach a stationary 
distribution x^'^^ ^'Hd we choose the preferred firing phase 
as the phase at which the neuron most likely fires. 



arg max x 



(7) 



Using this preferred phase as reset phase will yield a 
viable approximation to stimulation without reset only 
if the firing phase distribution is sharply concentrated 
around cj)* , and has only a single maximum. To ensure 
this, we require that the vector strength [Q of the dis- 
tribution fulfills 



> 0.9. 



(8) 



This condition is generally met by the sub-threshold 
stimuli combined with weak noise studied here. Mul- 
timodal firing phase distributions are observed only for 
slow stimuli in the presence of intermediate to large noise, 
and for superthreshold stimuli. We are therefore not con- 
cerned with complications that may arise from mode- 
locking as observed in the latter cases p9|-p2| . 



III. RESULTS 

A. Fixed Reset Phase 

For fixed reset phase, 0o = Oi the model neuron shows 
typical stochastic resonance behavior, i.e., a maximum of 
the SNR at an intermediate albeit small noise amplitude 
fmax as shown in Fig. ^(a) The mechanism induc- 
ing stochastic resonance is indicated in Fig. ^(b): the 
maximal SNR is reached when the peak frequency SI and 
the reset frequency f2rcs = 27r/Ti.es coincide, where Tics 
is the mode of the ISI density, i.e., the most probable in- 
terval between two stimulus resets. Coincidence of reset 
and peak frequencies thus indicates synchronization be- 
tween the stimulus reset and the correlations dominating 



the power spectrum of the output spike train, yielding 
optimal encoding of the nominal stimulus. 

This effect may intuitively be explained as follows. As- 
sume that the peaks of the ISI distribution are located 
around r — nT -|- e, e > 0, for a given choice of reset 
phase and small noise. The effective stimulus will then 
be a close to the nominal stimulus, cf. Fig. |l|(a). The neu- 
ron will fire at shorter intervals as the noise is increased, 
and for a particular noise amplitude will the peaks of the 
ISI distribution be centered about multiples of the stim- 
ulus period T. The effective stimulus will then be reset 
in intervals of nT . The neuron is thus on average driven 
by a periodic stimulus with period fires = f^, evoking as 
periodic a spike train as possible, i.e., one maximizing the 
signal-to-noise ratio. This explanation ignores all jitter 
in spike timing, which reduces the SNR. The SNR max- 
imum is thus not found for that input noise amplitude 
which yields fires = fi (cr ~ 0.018), but for somewhat 
weaker input noise, corresponding to smaller output jit- 
ter, cf. Fig. |(b). 



B. Noise- Adapted Reset Phase 

A LIF neuron driven by a sinusoidal stimulus which 
is not reset after each spike will approach a stationary 
firing pattern |47 2^. The preferred firing phase in the 
stationary state is given by Eq. (M) and depends on the 
noise amplitude as shown in Fig.nq(c): the neuron fires 
at later phases for weaker noise. Note that interspike 
intervals will be multiples of the stimulus period T in 
this regime, since the neuron fires all spikes at the same 
phase 4>* (up to jitter). 

This observation suggests how to construct a proper 
approximation to the full LIF dynamics using the reset 
model: for each stimulus and each noise amplitude, de- 
termine the preferred phase from Eq. and use this 
phase as reset phase. 



(/-O = 0o(ct; q, Vt) = 0*(cr; ^, q, Vl). 



(9) 



The stimulus is then reset in intervals of multiples of the 
stimulus period, so that the effective stimulus will differ 
from the nominal stimulus only through jitter. This jitter 
vanishes as input noise vanishes, whence perfect periodic 
stimulation will be attained for cr ^ 0. Consequently, 
the signal-to-noise ratio will diverge for vanishing noise 
as shown in Fig. ^(a). The reset frequency is identical 
to the nominal frequency by construction, f2ros = 
cf. Fig. |^(b). The peak frequency, on the other hand, 
converges to the stimulus frequency as noise vanishes, 
fi — > f^res = as the effective stimulus becomes identi- 
cal to the nominal one. 

We shall now make this argument rigorous. The ISI 
distribution of a LIF model neuron is well approximated 
by [H 



p(t) « ft.(r) exp 



h{s)ds 



(10) 
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ft.(r) — cxp 



1 - voir) 



(11) 



where vo{t) is the membrane potential in the absence of 
noise, i.e., the solution of Eq. (|l|) for cr = 0. We consider 
the limit of small noise (cr <C 1) and slow stimulation 
(T ^ 1). In that case, we can neglect transient terms in 
the membrane potential to obtain 



vo{t) = PL + qcos{VLT + no + 0(e-^), 



(12) 



where q = l/vT+iP, and C, — {ipo — arctanll)/!]. The 
hazard /i(t) will thus be a sequence of narrow peaks 
around the maxima of vq[t), i.e. around r„ = nT—C^. ISI 
lengths are multiples of the stimulus period for adapted 
reset phase by construction, whence C = for 0o ~ 

r(cT). 

As peaks are narrow, we may take the exponential term 
in Eq. (^o|) to be constant across each peak; it merely 
reduces the peak amplitude by a factor 7 for each sub- 
sequent peak. The ISI distribution can thus be approxi- 
mated as a superposition of dampened copies of the haz- 
ard fmiction centered about t„ = nT, i.e.. 



P{r) 



E7""'exp 



1 - Wo(r - T„) 



(13) 



with 7 — exp ^— j^^l'^ h{s)ds^ . Expanding the exponent 

separately for each summand and retaining only terms of 
lowest order in r — r„ yields, 



Pir) 



cJ2^" ^exp 

n=l 



(14) 



where r]~^ — q{l ^ fi ~ q), and c is a normalization fac- 
tor. The interspike-interval distribution has thus been re- 
duced to a sum of Gaussians. This approximation holds 
well for small noise, as shown in Fig. ^. 

The Fourier transform of the ISI distribution is thus 



(1 - 7) exp 



7](T 



+ 2TTi\ 



1 — 7 exp [Stti^] 



(15) 



In the limit of small noise and for adapted reset phase, the 
effective stimulus becomes equal to the nominal stimulus, 
and the spectral power will be maximal at the nominal 
stimulus frequency in this limit, i.e., 17 — s- for cr — > 0, 
cf. Fig. |(b). The signal-to -noise ratio is therefore 



s{n) 



coth-^ (cr < 1) 



(16) 



in good agreement with numerical results for the exact 
model (solid line in Fig. ||(a)). We find in particular that 
the signal-to-noise ratio diverges for vanishing noise in 
the Gaussian approximation. 



IV. CONCLUSIONS 

The aim of this paper was to clarify whether the re- 
sponse of the leaky integrate-and-fire neuron to periodic 
subthreshold stimulation can be approximated as a re- 
newal process. In particular, we wanted to know whether 
stochastic resonance at weak noise as reported in earlier 
work pO|p^ is a genuine property of the LIE neuron, or 
rather an artefact of the stimulus reset, which was intro- 
duced to reduce the full neuronal dynamics to a renewal 
process. 

We argued that renewal (endogenous) dynamics are 
a good approximation to the full (exogenous) dynamics 
only if the phase 0Oi to which the stimulus is reset after 
each spike, is adapted to the stimulus parameters, espe- 
cially the noise amplitude, in such a way that the neuron 
fires most likely at phase (pg. We showed that stochastic 
resonance does not occur in this case. Stochastic reso- 
nance is only found if the reset phase is held fixed as the 
amplitude of the input noise is varied. 

There is no biologically plausible way in which a neu- 
ron could reset a stimulus impinging on it to a fixed 
phase. Lansky suggested that neurons driven by inter- 
nally generated membrane potential oscillations could 
reset their oscillator to a fixed phase, hence the term 
endogenous stimulation Q. Cold receptor cells are 
driven by internal subthreshold oscillations, but do not 
reset their internal oscillator upon firing It is thus 
highly unlikely to find neurons which reset the oscillator 
that drives them to a fixed phase independent of stimu- 
lus properties, i.e., follow genuine endogenous dynamics. 
This in turn means that any effect arising solely from 
the reset to a fixed stimulus phase will not be found in 
real neurons. The stochastic resonance effect reported in 
Ref. [0 (see also 23|) is thus a model artefact. 

We stress that this conclusion applies only to the par- 
ticular type of stochastic resonance discussed here. The 
leaky integrate-and-fire neuron benefits from stochastic 
resonance when encoding periodic signals without reset 
(exogenous stimulation), as shown in [p2|24 2^. This res- 



onance occurs at noise amplitudes which are about one 
order of magnitude larger than the resonance found in the 
model with reset to a fixed phase. The crucial difference 
is that studies on exogenous stimulation consider either 
explicitly or implicitly the power spectral density of a 
spike train of finite duration, while an infinite spike train 
is assumed here, cf. Sec. II B. Trains of very low intensity. 



but precisely phase-locking to the stimulus, as found for 
very weak noise, yield a small finite-time signal-to-noise 
ratio, while their infinite-time SNR may be large. 

Other noise-induced resonance phenomena found in 
the LIE with stimulus reset, e.g., in the interspike- 
interval distribution or the mean ISI length |29y34[| , are 
not directly affected by our finding either. Indeed, 
Shimokawa et al. found comparable resonance effects in 
terms of the ISI distribution for stimulation with and 
without reset [E2| . These resonances occur at much larger 
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noise amplitudes than studied here; see also Ref. p3^ . 

Our findings should, on the other hand, not be re- 
stricted to the particular neuron model studied here. We 
expect that stochastic resonance may be introduced to 
nearly any threshold system when the full dynamics un- 
der periodic forcing are reduced to a renewal process by 
resetting the forcing to a noise-independent phase after 
each threshold crossing. Periodic forcing may then be re- 
covered by adjusting the noise such that threshold cross- 
ings occur around the predefined reset phase, whence pe- 
riodic forcing is recovered, and optimal output attained. 
Unless the fixed reset phase has a counterpart in the 
physical system under study, this resonance is obviously 
an artefact of a simplification carried too far. 
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FIG. 1. Effective stimulus and corresponding spike trains 
for fixed reset pfiases 00 = (top) and <?!>o = 7r/2 (bottom) are 
sliown in black, while the nominal stimuli are shown in grey. 
The reset has small consequences in the first case, while the 
effective stimulus differs markedly from the nominal sinusoid 
for the latter. T = 2tt/Q is the period of the nominal stim- 
ulus; amplitudes are in arbitrary units. Remaining stimulus 
parameters: ^ = 0.9, q — 0.1, fl — O.lvr, a — 0.008. 




FIG. 2. Interspike-interval distribution in response to pe- 
riodic stimulation with reset to phases (po = (black) and 
<j>o = 71/2 (grey). All else as in Fig. ^ 
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FIG. 3. Power spectral density for (a) reset phase 0o — 0, 
and (b) (j)o = n/2. The dashed horizontal line is the PSD 
Sp of a Poisson train of equal intensity; vertical dotted lines 
mark the interval [0.9^,1.1^], cf. Eq. (|). Note the lack of 
power in the vicinity of the nominal stimulus frequency Q for 
reset phase 0o = 71/2. All else as in Fig. ^. 
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FIG. 4. (a) Signal-to-noise ratio vs. input noise amplitude 
for fixed reset phase 0o = 0. (b) Peak frequency Q (solid) and 
reset frequency fires (dashed) vs. noise amplitude for fixed 
reset phase. The dotted horizontal line marks the nominal 
stimulus frequency Q = O.lvr, while the dotted vertical line 
marks the optimal noise amplitude. Stimulus parameters as 
in Fig. 0. 
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FIG. 5. (a) Signal-to-noise ratio vs. input noise amplitude 
for adapted reset phase 0o = 0*(o") (symbols) and for fixed 
reset phase (j>o = for comparison (dashed). The solid line is 
the approximation of Eq. (p^. (b) Peak frequency Cl (solid) 
and reset frequency f2rcs (dashed) vs. noise amplitude for fixed 
reset phase. The dotted line marks the nominal stimulus fre- 
quency, (c) Preferred frequency <j}*{o') vs. noise. Stimulus 
parameters as in Fig. 111. 
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FIG. 6. Gaussian approximation of Eq. ( |l^ (grey) to the 
interspike-interval distribution (black) for the same stimulus 
parameters as before and a — 0.0046. 
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